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Abstract 

We investigate the packing and covering densities of linear and nonlinear binary codes, 
and establish a number of duality relationships between the packing and covering 
problems. Specifically, we prove that if almost all codes (in the class of linear or non- 
linear codes) are good packings, then only a vanishing fraction of codes are good cov- 
erings, and vice versa: if almost all codes are good coverings, then at most a vanishing 
fraction of codes are good packings. We also show that any specific maximal binary 
code is either a good packing or a good covering, in a certain well-defined sense. 
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1. Introduction 



Let be the vector space of all the binary n-tuples, endowed with the Hamming metric. 
Specifically, the Hamming distance d{x, y) between x, y G E^" is defined as the number of 
positions where x and y differ. A binary code of length n is a subset of F2", while a binary 
linear code of length n and dimension /c is a fc-dimensional subspace of F2". Since we are 
concerned only with binary codes in this paper, we henceforth omit the "binary" quantifier 
throughout. The minimum distance of a code C C F2" is defined as the minimum Ham- 
ming distance between distinct elements of C. The covering radius of C is the smallest 
integer R such that for all x £ F^", there is a y G C with d{x, y) ^ R. For all other notation 
from coding theory, we refer the reader to the book of van Lint [8]. Van Lint [8, p. 34] calls 
the covering radius the "counterpart of minimum distance." Indeed, the trade-off between 
the parameters \C\,n,d, and R is one of the fundamental problems in coding theory. 

Let <^(n,M) denote the set of all codes C C F2" with |C| = M. Thus |<^(n,M)| = (^). 
Similarly, let ^{n, k) denote the set of all linear codes of length n and dimension k. Thus 
the cardinafity of ^(n, k) is given by \^(n, k) \ = Y^r] (2« - X) / {l^ - 2') . We will be 
interested in questions of the following kind. Given a property P which determines the 
packing or covering density of a code, what fraction of codes in '^(n, M) and/or J^(n, k) 
have this property? Moreover, how does this fraction behave as n ^ 00? Our main results 
are curious duality relationships between such packing and covering problems. In partic- 
ular, we show that: 

^ Any maximal code is good. That is, any specific maximal code C C Fj" is either 
a good packing or a good covering, in a certain well-defined sense. 

^ If almost all codes in '^{n,M) are good coverings, then almost all codes in 
"^(n, M + 1) are had packings. Vice versa, if almost all codes in '^(n, M + 1) 
are good packings, then almost all codes in '€{n, M) are had coverings. 

^ The same is true for linear codes. That is, ^ holds with ^{n, M) and'rf(n, M+1) 
replaced by ^{n, k) and ^{n, ^: + 1), respectively. 

The definition of what we mean by "good packing" and "good covering" is given in the 
next section. Precise statements of and % may be found in §3 and §4, respectively. 



2. Definitions 

The covering density of a code C C F2" is defined in [3] as the sum of the volumes of 
spheres of covering radius R about the codewords of C divided by the volume of the space: 



where Br{x) = {y G F2" : d{x, y) ^ r} is the sphere (ball) of radius r centered at x G F2" 
and V{n,r) = YJ'i=oCi) is the volume (cardinality) of Br{x). We find it extremely conve- 
nient to extend this definition of density to arbitrary radii as follows. 
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Definition 1. Given a code C C and a nonnegative integer r ^ n, the r-density of C is 

defined as 
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Many well-known bounds on the packing and covering density of codes can be concisely 
stated in terms of the r-density. For example, if R, d, and t = [{d—l)/2\ denote the cov- 
ering radius, the minimum distance, and the packing radius, respectively, then 

Sphere-packing bound: (pt{C) ^ 1 for all C C F2" (2) 
Sphere-covering bound: (Pr{C) ^ 1 for all C C ¥2 (3) 

The classical Gilbert- Varshamov bound [8] asserts that for all n and d ^ n, there exist 
codes in ^(n,M) whose minimum distance satisfies M ^ 2^ /V{n,d—1). Equivalently 



Gilbert-Varshamov bound: \jn,\jd ^ n, there exist C C F2", such that (P(^_x(C) ^ 1 (4) 

Recently, this bound was improved upon by Jiang and Vardy [7] who proved that for all suff- 
iciently large n and all* d ^ 0.499n, there exist codes C C with minimum distance d 
such that |C| ^ on TP- jVin, d—V), where c is an absolute constant. Equivalently 

3c > 0, Vn ^ no, Vrf ^ 0.499n, there exist C C F2", such that (Pd-i(C) ^ cn (5) 

The best known existence bounds for covering codes can be also expressed in terms of the 
r-density, except that one should set r = rather than r = d — 1. Thus 

Vn, VK < n /2, there exist linear C C F2", such that (Pr{C) ^ (6) 
Vn, VR < n /2, there exist C C F2", such that (Pr{C) ^ (In 2)n (7) 

where the first result is due to Cohen [4] while the second is due to Delsarte and Piret [5]. 
Motivated by Q - ©, we introduce the following definition. 

Definition 2. Let f{n) be a given function, and let C C F2" be a code with minimum dis- 
tance d and covering radius R. We say that C is an f{n) -good packing if (p^-i (C) ^ f{n) . 
We say that C is an f{n) -good covering if <Pr(C) ^ f{n) . 



3. Duality for a specific maximal code 

A code C C F2" is said to be maximal if it is not possible to adjoin any point of F2" to C 
without decreasing its minimum distance. Equivalently, a code C with minimum distance d 



*The condition d ^ 0.499n has been now improved to the more natural d < n/2 by Vu and Wu [9]. Vu and 
Wu [9] also show that a similar bound holds over any finite filed provided (i < n[q—l)/q. 
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and covering radius R is maximal if and only if R ^ d — 1. Our first result is an easy theo- 
rem, which says that any maximal code is either a good packing or a good covering. 

Theorem 1. Let f{n) be an arbitrary function of n, and let C C be a maximal code. 
Then C is an f{n)-good packing or an f{n)-good covering (or both). 

Proof. By definition, C is not an /(n)-good packing if (Pi^_i{C) < f{n). But this im- 
plies that (P_r(C) ^ (P(i_i(C) < f{n), so C is an /(n)-good covering. | 

For example, taking /(n) = 9{n), Theorem[T]implies that, up to a constant factor, any max- 
imal code attains either the Jiang- Vardy bound Q or the Delsarte-Piret bound Q. 

4. Duality for almost all codes 

We begin with three simple lemmas, which are needed to prove Theorems |5] and |6l our 
main results in this section. The following "supercode lemma" is well known. 

Lemma 2. Given a code C, let d{C) and R(C) denote its minimum distance and covering 
radius, respectively. If C is a proper subcode of another code C, then R{C) ^ d{C). 

Proof. Since C C C, there exists an x G C \ C. For any c G C, we have d{x, c) ^ d(C') . 
Hence R{C) ^ d{C') by definition. | 

Lemma 3. Let S' C ^(n, M+1) be an arbitrary set of codes of length n and size M+1, 
and let S = {Ce "^{n, M) : C C C for some C eS'}. Then the fraction of codes in S 
is greater or equal to the fraction of codes in S', namely 

\S\ ^ \S'\ 
|^(n,M)| ^ |<^(n,M+l)| 

Proof. Define a bipartite graph Q as follows. The left vertices, respectively the right ver- 
tices, of Q are all the codes in ^(n, M), respectively all the codes in "^(n, M+1), with 
C G <^(n, M) and C G ^(n, M+1) connected by an edge iff C C C. Then g is bi-regu- 
lar with left-degree 2" — M and right-degree M + 1. Hence the number of edges in Q is 

\E{g)\ = (M + l)|'^(n,M+l)| = (2" -M)|^(n,M)| (8) 

Now consider the subgraph TC induced in Q by the set «S'. Then the left vertices in Ti are 
precisely the codes in S, and every such vertex has degree at most 2" — M. The degree of 
every right vertex in Ti is still M + 1. Thus, counting the number of edges in Ti, we obtain 

\E{n)\ = {M+1)\S'\ ^ (2"-M)|<S| (9) 

The lemma follows immediately from dSj) and Q. Observe that the specific expressions for 
the left and right degrees of Q are, in fact, irrelevant for the proof. | 
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Lemma 4. Let S' C Jf(n, k+1) be an arbitrary set of linear codes of length n and dimen- 
sion k+1, and let S = {Ce ^{n, k) : C C C for some C G S'}. Then the fraction of 
codes in S is greater or equal to the fraction of codes in S', namely 

|>S| |>S^| 
\^in,k)\ ^ \^{n,k+l)\ 

Proof. The argument is identical to the one given in the proof of Lemma|3l except that 
here we use the bipartite graph defined on =Sf (n, k) U ^{n,k+l). | 

The next theorem establishes the duality between the fraction of good coverings in ^{n, M) 
and the fraction of good packings in "^(n, M + 1). In order to make its statement precise, 
we need to exclude the degenerate cases. Thus we henceforth assume that n ^ M ^ 2" — 1. 

Theorem 5. Let f{n) be an arbitrary function. Let a G [0, 1] denote the fraction of codes 
in '^{n, M) that are f{n)-good coverings, and let (3 G [0, 1] denote the fraction of codes in 
^(n, M + 1) that are f{n) -good packings. Then ct + ^ ^ 1 . 

Proof. Let *S' be the set of all codes in '^{n, M + 1) that are /(n)-good packings. Thus 
|5'|/|^(n,M+l)| = (3. Further, let 5 = {CG^(n,M) : C C C for some C G 5'} as 
in Lemma|3l We claim that none of the codes in S is an /(n)-good covering. Indeed, let 
C G 5, and let C eS'hea code such that C C C Set = J^(C) and d = d{C'). Then 

(Pr{C) ^ (pa{C) (byLemmaEI (10) 

> (Pd-i{C') (trivial from Q if M ^ n) (11) 
^ /(n) (C' is an /(n)-good packing) (12) 

Thus C is not an /(n)-good covering, as claimed. Hence 1 — a ^ \S\/\^{n, M)\. The 
theorem now follows immediately from Lemma|3] | 

For linear codes, exactly the same argument works, except that we need a factor of 2 in (fTTT) . 
since |C'| = 2|C| for any C G ^{n,k) and C G ^{n,k+l). For the functions f{n) of 
the kind one usually considers, such constant factors are not particularly significant. 

Theorem 6. Let f{n) be an arbitrary function. Let a G [0, 1] denote the fraction of codes 
in j5f (n, k) that are f{n) -good coverings, and let 13 G [0, 1] denote the fraction of codes in 
^{n,k + 1) that are 2f{n)-good packings. Then a + (3 ^ 1. 

Proof. Follows from Lemmas |2l and |4l in the same way as Theorem|5l follows from Lem- 
masElandEI Explicitly, (0 - (d) becomes (Pr{C) ^ (pa{C) > ViVd-ii^') ^ I 

5. Discussion 

Clearly, Theorems |5] and pimply the statements and 0, respectively, made in §1. If 
tends to one as n ^ oo, then (3 tends to zero, and vice versa if ^ ^ 1 then a ^ 0. 
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It is well known [8] that almost all linear* codes achieve the Gilbert- Varshamov bound (|4|). 
Hence an intriguing question is what fraction of codes in ^{n,k) achieve the stronger 
bound © of Jiang and Vardy [7]. Combining Theorem|^with the results of Blinovskii [2] 
on random covering codes establishes the following theorem. 

Theorem 7. Letn andk = An be positive integers, with < A < 1. For any real £ > 0, 
let I3c{n,k) denote the fraction of codes in ^(n,k) whose minimum distance d is such 
that q)a-i{C) ^ n^^^. Then I3e{n,k) tends to zero asn ^ oo, for all e and A. 

We omit the proof of Theorem|71 since Dumer [6] recently proved a stronger result. Specif- 
ically, Dumer [6] shows that the fraction of linear codes that are /(n)-good packings tends 
to zero as n ^ oo for any function /(n) such that lim„^oo/('^) = oo. This implies that 
as n ^ CO, almost all linear codes satisfy (p^_i{^l) = 6(1). 



Acknowledgment. We are grateful to Alexander Barg and Ilya Dumer for helpful discus- 
sions. We are especially indebted to Ilya Dumer for sending us his proof in [6]. 
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We investigate the packing and covering densities of linear and nonlinear binary codes, 
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fraction of codes are good packings. We also show that any specific maximal binary 
code is either a good packing or a good covering, in a certain well-defined sense. 



Supported in part by the David and Lucile Packard Fellowship and by the National Science Foundation. 



1. Introduction 



Let be the vector space of all the binary n-tuples, endowed with the Hamming metric. 
Specifically, the Hamming distance d{x, y) between x, y G E^" is defined as the number of 
positions where x and y differ. A binary code of length n is a subset of F2", while a binary 
linear code of length n and dimension /c is a fc-dimensional subspace of F2". Since we are 
concerned only with binary codes in this paper, we henceforth omit the "binary" quantifier 
throughout. The minimum distance of a code C C F2" is defined as the minimum Ham- 
ming distance between distinct elements of C. The covering radius of C is the smallest 
integer R such that for all x £ F^", there is a y G C with d{x, y) ^ R. For all other notation 
from coding theory, we refer the reader to the book of van Lint [8]. Van Lint [8, p. 34] calls 
the covering radius the "counterpart of minimum distance." Indeed, the trade-off between 
the parameters \C\,n,d, and R is one of the fundamental problems in coding theory. 

Let <^(n,M) denote the set of all codes C C F2" with |C| = M. Thus |<^(n,M)| = (^). 
Similarly, let ^{n, k) denote the set of all linear codes of length n and dimension k. Thus 
the cardinafity of ^(n, k) is given by \^(n, k) \ = Y^r] (2« - X) / {l^ - 2') . We will be 
interested in questions of the following kind. Given a property P which determines the 
packing or covering density of a code, what fraction of codes in '^(n, M) and/or J^(n, k) 
have this property? Moreover, how does this fraction behave as n ^ 00? Our main results 
are curious duality relationships between such packing and covering problems. In partic- 
ular, we show that: 

^ Any maximal code is good. That is, any specific maximal code C C Fj" is either 
a good packing or a good covering, in a certain well-defined sense. 

^ If almost all codes in '^{n,M) are good coverings, then almost all codes in 
"^(n, M + 1) are had packings. Vice versa, if almost all codes in '^(n, M + 1) 
are good packings, then almost all codes in '€{n, M) are had coverings. 

^ The same is true for linear codes. That is, ^ holds with ^{n, M) and'rf(n, M+1) 
replaced by ^{n, k) and ^{n, ^: + 1), respectively. 

The definition of what we mean by "good packing" and "good covering" is given in the 
next section. Precise statements of and % may be found in §3 and §4, respectively. 



2. Definitions 

The covering density of a code C C F2" is defined in [3] as the sum of the volumes of 
spheres of covering radius R about the codewords of C divided by the volume of the space: 



where Br{x) = {y G F2" : d{x, y) ^ r} is the sphere (ball) of radius r centered at x G F2" 
and V{n,r) = YJ'i=oCi) is the volume (cardinality) of Br{x). We find it extremely conve- 
nient to extend this definition of density to arbitrary radii as follows. 
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Definition 1. Given a code C C and a nonnegative integer r ^n, the r-density of C is 
defined as 

def Lcec\Bric)\ _ \C\Vin,r) 

Many well-known bounds on the packing and covering density of codes can be concisely 
stated in terms of the r-density. For example, if R, d, and t = [(d— 1)/2J denote the cov- 
ering radius, the minimum distance, and the packing radius, respectively, then 

Sphere-packing bound: (pt(C) ^ 1 for all C C ¥2 (2) 
Sphere-covering bound: <Pr(C) ^ 1 for all C C F2" (3) 

The classical Gilbert- Varshamov bound [8] asserts that for all n and d ^ n, there exist 
codes in ^{n, M) whose minimum distance d satisfies M ^ 2"/V{n, d—1). Equivalently 

Gilbert-Varshamov bound: yn,yd ^ n, there exist C C F2", such that ^^_i(C) ^ 1 (4) 

Recently, this bound was improved upon by Jiang and Vardy [7] who proved that for all suff- 
iciently large n and all* d ^ 0.499n, there exist codes C C F2" with minimum distance d 
such that |C| ^ on 2"/y(n, d—1), where c is an absolute constant. Equivalently 

3c > 0, Vn ^ no, Vrf ^ 0.499n, there exist C C Ff, such that (Pd-i(C) ^ on (5) 

The best known existence bounds for covering codes can be also expressed in terms of the 
r-density, except that one should set r = R rather than r — d — 1. Thus 

Vn, VK < n /2, there exist linear C C F2", such that (Pr{C) ^ (6) 
Vn, VR < n/2, there exist C C F2", such that (Pr{C) ^ (In 2)n (7) 

where the first result is due to Cohen [4] while the second is due to Delsarte and Piret [5]. 
Motivated by (4) - (7), we introduce the following definition. 

Definition 2. Let f{n) be a given function, and let C C F2" be a code with minimum dis- 
tance d and covering radius R. We say that C is an f{n) -good packing if (Pd-i (C) ^ /(n) . 
We say that C is an f(n) -good covering if cpR (C) ^ /(n) . 



3. Duality for a specific maximal code 

A code C C F2" is said to be maximal if it is not possible to adjoin any point of F2" to C 
without decreasing its minimum distance. Equivalently, a code C with minimum distance d 
and covering radius R is maximal if and only if R ^ d — 1. Our first result is an easy theo- 
rem, which says that any maximal code is either a good packing or a good covering. 



*The condition d ^ 0.499n has been now improved to the more natural d < n/2 by Vu and Wu [9]. Vu and 
Wu [9] also show that a similar bound holds over any finite filed provided d < n{q—l)/q. 
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Theorem 1. Let f(n) be an arbitrary function of n, and let C C be a maximal code. 
Then C is an f(n)-good packing oranf(n)-good covering (or both). 

Proof. By definition, C is not an /(n)-good packing if (prf_i(C) < f{n). But this im- 
pUes that (Pr(C) ^ (P(f_i(C) < /(n), so C is an /(n)-good covering. | 

For example, taking /(n) = d{n) , Theorem 1 implies that, up to a constant factor, any max- 
imal code attains either the Jiang-Vardy bound (5) or the Delsarte-Piret bound (7). 

4. Duality for almost all codes 

We begin with three simple lemmas, which are needed to prove Theorems 5 and 6, our 
main results in this section. The following "supercode lemma" is well known. 

Lemma 2. Given a code C, let d(C) and R(C) denote its minimum distance and covering 
radius, respectively. If C is a proper subcode of another code C, then R{C) ^ d{C). 

Proof. Since C C C, there exists an x G C' \ C. For any c £ C, we have d(x, c) ^ d{C). 
Hence R{C) ^ d(C) by definition. | 

Lemma 3. Let S' C ^{n, M+1) be an arbitrary set of codes of length n and size M+1, 
and let S = {Ce 'rfin, M) : C C C for some C eS'}. Then the fraction of codes in S 
is greater or equal to the fraction of codes in S', namely 

|<S| ^ \S'\ 
Y^{nM)\ ^ |^(n,M+l)| 

Proof. Define a bipartite graph Q as follows. The left vertices, respectively the right ver- 
tices, of Q are all the codes in "^(n, M), respectively all the codes in ^(n, M+1), with 
C e ^(n, M) and C e "^(n, M+1) connected by an edge iff C C C Then Q is bi-regu- 
lar with left-degree 2" — M and right-degree M + 1. Hence the number of edges in Q is 

|£(g)| = (M + l)|'^(n,M+l)| = (2"-M)|<^(n,M)| (8) 

Now consider the subgraph H induced in Q by the set S' . Then the left vertices in H are 
precisely the codes in »S, and every such vertex has degree at most 2" — M. The degree of 
every right vertex in is still M + 1. Thus, counting the number of edges in 7Y, we obtain 

|£(7^)| = (M + l)|5'| ^ {r-M)\S\ (9) 

The lemma follows immediately from (8) and (9). Observe that the specific expressions for 
the left and right degrees of Q are, in fact, irrelevant for the proof. | 

Lemma 4. Let S' C ^{n, fc+ 1) be an arbitrary set of linear codes of length n and dimen- 
sion + 1, and let 5 = {C G ££{n, k) : C C C for some C G S'}. Then the fraction of 
codes in S is greater or equal to the fraction of codes in S', namely 

|<S| ^ \S'\ 
\^{n,k)\ ^ \^(n,k+l)\ 

Proof. The argument is identical to the one given in the proof of Lemma 3, except that 
here we use the bipartite graph defined on ^{n,k) U ^{n,k+l). | 
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The next theorem establishes the duality between the fraction of good coverings in ^(n, M) 
and the fraction of good packings in ^{n, M + 1). In order to make its statement precise, 
we need to exclude the degenerate cases. Thus we henceforth assume that n ^ M ^ 2" — 1. 

Theorem 5. Let f{n) be an arbitrary function. Let a G [0, 1] denote the fraction of codes 
in ^{n, M) that are f(n)-good coverings, and let (5 G [0, 1] denote the fraction of codes in 
"^{n, M + 1) that are f{n)-good packings. Then a + 13 ^1. 

Proof. Let S' be the set of all codes in ^(n, M + 1) that are /(n)-good packings. Thus 
|»S'|/|'^(n,M+l)| = 13. Further, let 5 = {CG^(n,M) : C C C for some C G 5'} as 
in Lemma 3. We claim that none of the codes in S is an /(n)-good covering. Indeed, let 
CeS, and let C G 5' be a code such that C C C. Set R = R{C) and d = d{C'). Then 

(Pr{C) ^ (pa{C) (byLemma2) (10) 

> (Pd-i(C') (trivial from (1) if M > n) (11) 
^ f(n) (C' is an /(n) -good packing) (12) 

Thus C is not an /(n)-good covering, as claimed. Hence 1 — a ^ |»S|/|^(n, M)|. The 
theorem now follows immediately from Lemma 3. | 

For linear codes, exactly the same argument works, except that we need a factor of 2 in (1 1), 
since |C'| = 2|C| for any C G ^{n,k) and C G ^{n,k+l). For the functions f{n) of 
the kind one usually considers, such constant factors are not particularly significant. 

Theorem 6. Let f{n) be an arbitrary function. Let a G [0, 1] denote the fraction of codes 
in J^{n,k) that are f{n) -good coverings, and let ^ G [0, 1] denote the faction of codes in 
^{n,k + 1) that are 2f{n) -good packings. Then a + )3 ^ 1. 

Proof. Follows from Lemmas 2 and 4 in the same way as Theorem 5 follows from Lem- 
mas 2 and 3. Explicitly, (10)-(12) becomes (Pr(C) ^ (pd{C) > y2(Pd_i(C') ^ /(n). | 



5. Discussion 

Clearly, Theorems 5 and 6 imply the statements and respectively, made in §1. If a 
tends to one as n — > oo, then /3 tends to zero, and vice versa if ^ — > 1 then a — > 0. 

It is well known [8] that almost all linear* codes achieve the Gilbert- Varshamov bound (4). 
Hence an intriguing question is what fraction of codes in ^{n,k) achieve the stronger 
bound (5) of Jiang and Vardy [7]. Combining Theorem 6 with the results of Blinovskii [2] 
on random covering codes establishes the following theorem. 

Theorem 7. Let n and k = An be positive integers, with < A < 1. For any real e > 0, 
let Peijifk) denote the fraction of codes in ^{n,k) whose minimum distance d is such 
that ipd-i (C) ^ n^"*"^. Then ^^(n, k) tends to zero as n —> oo, for all e and A. 



*It is also known [1] that almost all nonlinear codes do not achieve the Gilbert- Varshamov bound. 
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We omit the proof of Theorem 7, since Dumer [6] recently proved a stronger result. Specif- 
ically, Dumer [6] shows that the fraction of linear codes that are /(n)-good packings tends 
to zero as n ^ oo for any function /(n) such that lim„^oo/(w) = oo. This implies that 
as n — > oo, almost all linear codes satisfy cpi^_i{C) = 6(1). 



Acknowledgment. We are grateful to Alexander Barg and Ilya Dumer for helpful discus- 
sions. We are especially indebted to Ilya Dumer for sending us his proof in [6]. 
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